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Theory  Development _ 

□  Stephen  Fiore,  Ph.D. 

■  Department  of  Philosophy,  Cognitive  Sciences 
Program  and  Institute  for  Simulation  and  Training, 
University  of  Central  Florida 

□  Team 

■  C.  Shawn  Burke,  Ph.D. 

■  Alex  Kirlik,  Ph.D. 

■  Valerie  Sims,  Ph.D. 
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■  Rebecca  Lyons 
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Presentation  Overview 

□  Part  I 

■  Putting  it  in  Perspective 

□  Part  II 

■  Pursuing  a  Multi-level  Perspective 
to  Multi-Level  Theory  Development 
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Putting  it  in  Perspective _ 

Theory  Development  -  Overarching  Objective 

□  Can  we  develop,  refine,  test,  and  validate  a  theory  of 
macrocognition? 

■  Use  CKI  Program 's  extant  model  of  collaborative 
problem  solving  (Warner  et  aL,  2005)  as  initial  point 
of  departure 

□  What  constructs  and  mechanisms  contribute  to 
collaboration? 

■  Integrate  literatures  that  both  directly  and  indirectly 
bear  on  complex  team  problem  solving  activities 
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Putting  it  in  Perspective 

□  Historicai  Perspective 

■  An  oid  issue  in  studies  of  group  performance 

□  All  port,  F.H.  (1920).  The  influence  of  the  group  upon  association 
and  thought.  Journal  of  Experimental  Psychology,  3.  159-182. 

□  Shaw,  M.E.  (1932).  A  comparison  of  individuals  and  small  groups 
in  the  rational  solution  of  complex  problems.  American  Journal  of 
Psychology,  44,  491-504. 

□  Thorndike,  R.L.  (1938).  On 
what  type  of  task  will  a  group 
do  well?  Journal  of  Abnormal 
Psychology.  33.  408-412. 
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Putting  it  in  Perspective 

□  Historicai  Perspective 

■  In  early  research  for  the  military  Glaser  (1958)  noted: 

□  Process  variables  such  as  "anticipatory  cueing"  and  "sequence 

predictability"  could  facilitate  team  coordination. 

■  Steiner's  (1972)  seminal  work  on  group  productivity  noted: 

□  Coordination  decrements  resulted  in  teams  often  performing 
below  full  potential,  a  phenomenon  he  termed  process  loss. 


Putting  it  in  Perspective 


Historicai  Perspectives 
■  Evoived  into: 


TEAM  COCNmON 

UM  A  I  ri1  b  u  A  I  H  C  Pihi  lH*^ 

DHIVr  JNf] 

I  P*  H+  ■■ 

Ediurdo  iTid  Sttph«fi  M.  PiDie 


THE  WILD 


□  Distributed  Cognition  in 
Cognitive  Science 

□  Situated  Cognition  in 
Education  Research 

□  Team  Cognition  in 
Organizational  Research 


Now  Macrocognition 

■  An  interdisciplinary  integration  of  varied  theories  and  methods 

■  Overarching  Epistemological  Issue: 

■  How  does  the  manifestation  of  high  ievei  cognition  in  varied  contexts 
influence  coiiaboration  and  performance? 


Edwin  Hutchinfl 
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Putting  it  in  Perspective 

Multidisciplinary  research  to  foster  interdisciplinary  understanding 

□  Multidisciplinary  Research 

■  Coordinated  efforts  of  several  disciplines  to  achieve  a  common  goal 

■  Contributions  from  different  disciplines  are  complementary  not  integrative 

■  In  service  of  objective,  adopts  but  not  necessarily  integrate 

□  Interdisciplinary  Research 

■  Integration  of  several  disciplines  creating  a  unified  outcome 

■  Integrates  techniques,  tools,  perspectives,  concepts,  and/or  theories 

■  Requires  collaboration  at  the  level  of  designing  new  types  of  (experimentaO 
approaches  and  analysis  that  combine  methods  and  concepts  from  different 
disciplines. 

□  Macrocognition  represents  a  focal  area  to  unite  different  disciplines  to 
solve  complex  problems  -  taking  us  towards  interdisciplinarity 

■  Research  cuts  across  disciplines: 

□  Psychology,  Computer  Science,  Information  Science,  Organizational 
Behavior,  Engineering 


National  Academies,  Committee  on  Facilitating  Interdisciplinary  Research  (2005).  Facilitating  interdisciplinary 
research.  Washington,  DC:  National  Academies  Press. 


Pursuing  a  Multi-level  Perspective  to  Multi-Level 
Theory  Development _ 


Macrocognition  at  10®  Feet"  -  Perspective  at 
the  Meta-scientific  Levei  -  Creating 
Conditions  for  Coiiaborative  Dialog 


"Macrocognition  at  10®  Feet"  -  Perspective  at 
the  SUMMIT  Level  -  Buiiding  Theory  for 
Macrocognition  Research 


Macrocognition  at  10^  Feet"  -  Perspective  at 
the  Project  Level  -  Developing  Theoretica 
Concepts  within  Macrocognition  Research 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level 

Creating  Conditions  for  Collaborative  Dialog 

□  Component  devoted  to  developing  and  sharing  the  relevance 
of  macrocognition  to  scientific  research  for  the  21®*  Century 

■  ASKING:  What  do  scientists  mean  by  macrocognition? 


Developing  opportunities  for 
dialog  among  scientists  via 
symposia  at  international 
conferences 

Website  Development 

Special  Issue  Planning 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level 

How  have  the  sciences  been  using  the  concept  MacrocognitiorR 
□  Macrocognition  in  Neuroscience 

■  Macrocognition  refers  to  "those 
processes,  such  as  reasoning  and 
communication,  where  analysis 
does  not  take  place  at  the  level  of 

the  single  processing  unit"  (Bara, 

1995,  p.  77). 

■  Macrocognition  is  cognition  manifest  at  the  cortical  network 
level  whereas  microcognition  is  cognition  more  at  neural  level 
(Wilkes,  1997) 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level _ 

How  have  the  sciences  been  using  the  concept  Macrocognitionl 
□  Macrocognition  \v\  Cognitive  Engineering 

■  "Macrocognition  refers  to  the  study 
of  the  roie  of  cognition  in  reaiistic 
tasks,  that  is,  in  interacting  with  the 
environment 

■  —  more  concerned  with  human 
performance  under  actuai  working 
conditions  than  with  controiled 
experiments"  (Cacciabue  &  Hollnagel, 

1995,  p.  57). 

■  Macrocognition  involves  contextually  bound  cognitive  processes  such 
as  sense  making,  uncertainty  management,  in  settings  such  as 
industrial  process  control:  planning  a  mission  (Hutton,  Miller,  & 
Thorsden,  2003;  Helander,  2006;  Klein  et  al.,  2003). 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level _ 

How  have  the  sciences  been  using  the  concept  MacrocognitiorR 


Macrocognition  in  Coiiaboration  and Knowiedge  Interoperabiiity 
(Warner  and  Letsky,  in  press) 


□  Macrocognition  is  the  internalized  and 
externalized  high-level  mental  processes  (i.e., 
combining,  visualizing,  and  aggregating 
information) 

□  Resolve  ambiguity  in  support  of  discovery  of 
new  knowledge  and  relationships 

□  Employed  by  teams  during  complex,  one-of-a- 
kind,  problem  solving 


T  \ 

^  CoilaljQi^ion 

Knowledge 
*3  /■J  Interoperability 

Program 


1.  Have  adopted  this  as  SUMMIT  projects  working  definition 

2.  Have  been  interacting  with  differing  groups  on  developing  shared 
conceptualization  of  term 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level 


Creating  Conditions  for  Collaborative  Dialog  -  Pane/  Presented 


□  8*^  International  Conference  on  Naturalistic  Decision  Making 


Panel  Session 

Multiple  Pe  rsp  e  ctive  s  on  the  Ma  cro  c  o  gnitio  n  C  o  nstrnct' ' 

8th  International  Conference  on  Naturalistic  Decision  Makuig 

Chairs 

Robert  R.  Hoffman,  Ph.D. 

Senior  Research  Scientist 

Florida  Institute  for  Human  &  Machine  Cognition 
40  South  Alcaniz  St. 

Pensacola,  FL  32502-6008 
rhoffman®ihmc.us 

(850)  202-4418 

Eduardo  Salas,  Ph.D. 

University  of  Central  Florida 

3100  Technology  Parkv^ay 

Orlando,  FL  32826 

407-882-1325 
esalas(Slist.ucf  edu 

1 

Panehsts 

Gary  Klein,  Ph.D. 

Klein  Associates,  Inc. 

1750  Commerce  Center  Blvd.  North 

Fairborn,  OH  45324-3987 

(937) 873-8166 

sary  (Side  c  i  s  i  o  nmakins  .com 

Shawn  Burke,  Ph.D. 

University  of  Central  Florida 

3100  Technology  Parkway 

Orlando,  FL  32826 

407-882-1326 
sburke(Slist.ucf  edu 

James  J.  Staszewski,  Ph.D. 

Professor  (Research)  -  Cognitive 

Department  of  Psychology 

Carnegie  Mellon  University 

Pittsburgh,  PA  15213 
(412)  268-8881 
iis(Sicmu.  edu 

Nancy  J.  Cooke,  Ph.D. 

Applied  Psychology 

7001  E.  Williams  Field  Rd.  Sutton  #140 
Mesa,  AZ  85212 

480-988-2173 
ncooke  (Slasu.edu 

Multiple  Perspectives  on  the 
Macrocoanition  Construct  (Hoffman 
&  Salas,  Chairs) 

□  Panel  Goals 

■  Advance  discussion  of  differing  views 
of  macrocognition 

■  Discuss  development  of  measures 
designed  to  evaluate  macrocognitive 
team  processes 

■  Discuss  issues  arising  when 
developing  research  environments 
that  support  experimentation  in 
macrocognitive  processes 

□  SUMMIT  beginning  a  diaiogue  with 
NDM  community 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level 

Creating  Conditions  for  Collaborative  Dialog  —  Symposium  Presented 
□Society  for  Applied  Research  in  Memory  and  Cognition 

Macrocognition  in  Teams:  Applying  Cognitive  Psychology  to  Support  our 
Understanding  of  Complex  Collaborative  Processes  (Fiore  &  Salas,  Chairs) 

□  Paper  Titles 

■  Understanding  Macrocognition  in  Team  Coiiaboration  -  Norman  W.  Warner  and  Michael 
Letsky 

■  Constructing  Activity  Awareness  in  Computer  Supported  Coiiaborative  Work-'\o\\x\  M. 

Carroll 

■  Cognitiveiy  Transforming  Individuais  into  Team  Members:  Mentai  Modei  Convergence  and 
its  Impact  on  Team  Performance  -  Sara  McComb 

■  Linking  Ontoiogies  to  Support  Knowiedge  Interoperability  in  Teams  -  Webb  Stacy 

■  Musings  on  Macrocognition  in  Teams  and  the  Appiication  of  Cognition  to  our  Understanding 
of  Coiiaboration  -  Stephen  M.  Fiore  and  Eduardo  Salas 

□  Important  exposure  for  SUMMIT  and  CKI  to  new  communitv  of  scholars 


"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level _ 

Creating  Conditions  for  Collaborative  Dialog  -  Panel  Accepted 

Human  Factors  and  Ergonomic  Society  -  CEDM  TG 

Macrocognition  Metrics:  Meaningful  Measures  for  Complex  Processes 

□  Eduardo  Salas  and  Stephen  M.  Fiore,  Panel  Chairs 

Paper  Titles 

□  Macrocognition  in  Coiiaboration  and  Knowiedge  Interoperabiiity 

■  Michael  Letsky,  Office  of  Naval  Research 

□  Macrocognition  and  Compiex  Cognitive  Systems 

■  Gary  Klein,  Applied  Research  Associates  and  Robert  Hoffman,  Institute  for  Human  and 
Machine  Cognition 

□  Communication-Based  Metrics  of  Macrocognition 

■  Nancy  J.  Cooke,  Arizona  State  University 

□  Trianguiating  Metrics  for  Assessing  Macro- Levei  Cognitive  States:  Pushing  the 
Way  Forward 

■  C.  Shawn  Burke,  University  of  Central  Florida 

□  Metric  of  Rigor  in  Distributed  Anaiysis 

■  Emily  S.  Patterson,  Ohio  State  University 


Human  Factors  and 
Ergonomics  Society 


SUMMIT  promoting  dialogue  on  macrocognition 
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Macrocognition  at  10^  Feet' 

-  Perspective  at  the  Meta-scientific  Level 


Creating  Conditions  for  Collaborative  Dialog 

□  Website  Development  Update 

■  Expanded  Definitions 

■  Password  Access  to  DRAFTS 


University  of  Ccnlrol  florida  Microsoft  Inlerriet  fiiplorer 


Pll  E«  F«vert«s  Tods 

U"  ^  ^  y.  Sosrtti  «^F«ytrtot  ^ 


H  •  j  la  s 


O  I  I  ly  /I  IV  /I  I T  Systems  for  Understanding  and 
O  LJ  I V I  I V  M  I  Measuring  Macrocognition  in  Teams 


Internal  Draft  Documents 


OfW=  ’  fl]  BS  ■  □  3£l  S 

AJlldrK!;  |jg|| 


QlMd.  • 


e  :>■ 


II  l-l- 

OUlVMVM  1  Measuring  Macrocognition  in  Teams 

1  as;  IMM  [  ■  Hn»n  W  ll  3 1  IS  MaCfOCOg  II  it  lOU 

1  lyyi  ly /I  IT  Systems  for  Understanding  and 
\OLJIVIIVII  1  Measuring  Macrocognition  in  Teams 

Ttiv  toHowitiy  ore  document  lurrenUy  tor  Mom&t  dinorntrution  tnd  n 
llicorv  Pupcrs  oti  Mjcrocogtiitiuii 
CCRTS  fiDBl  SuttitltteiLai 


3M4A0  biMs.  tsw  modibed  on  2/2\fiW  lltoatSO  AM 


yOviNn frill FuJ  ftirf  Axc^rpJlMi  tram  1  o(rUt)r,  urjumrr,  J^iora^  aicfin^  jjirf  f  7fMJ7 J 


*  MeJIo  f  Uoi^ 


■  PERDtirel 

*  SlIuiiUsIs  Plt!VL-on.lF 

*  llnk^ 

■  HdcrDcegnItiDn 


LMSki,  M.,  W^irrtOr,  H..  fiOrfl.  S.M.,  ftOSQh,  Mi.,  $  $3fc5i.  £■  (200?].  M^ldrecOOnifieh  in  Cam'f 
Problem  Solving.  To  in  fho  PrOitOOdirifiS  Of  ftiO  \  1,th  [ntOniati<oVlJ  Corrimrur'i: 

Control  eo?«ncn  ^no  TftChnolOOr  Syft^ium  (ICCfiTS>,  CiftibriOge:  UK. 


Ocriiiiny  Mdc;rui;uyr»illuiir 


Wrftlin  rti«  fiold  of  0ng«Wring,ttT00ri5«  hovo  pfOpOWJ  tii(s  Mrffi  "rfi.lfffjrognitin! 

how  cognitita^  orn«V^  in  eVltur^ll  OArkfaWtonti.  Itaf  lin»  Of  thinking  ii  &$^Ci^ll|r 
upon  woat  of  Cstdibob  Snd  Ho*>.ggel  (  wtaj  speC^iHlIy  nptwi:  "Mscnwognrtion 
Che  studr  cf  the  rplB  of  Bogntian  in  reaikstK  tasks,  that  is,  in  intaractinD  wflhthe  enrironma 


3  SUMMII  MUKI  at  University  of  Central  florida  Microsoft  Internet  txpbrer 


n»  E«  Mtw  Fevgntts 


e 


f£l  Ti 


Tablo  I.  Ctiaractanetics  ot  macrocogniDon  m  teams 


1 

UnM  of  Aiielysis 

The  unc  of  analysis  rdudas  both  the  individual  tea 
teem  because  of  the  urvque  mecrocogrkbve  procas 
ndmduel  end  teem  level 

1  rvel  of 

Analysis 

Cognove  achviDes  are  anafrred  at  a  hgh  level  b«i 
usmg  micro  oogrvtive  processes  to  explaei  higher  c 
mechanisms:  addtionalv.  K  mar  be  at  this  level  th; 
emtrges,  a  variance  important  to  drtferentiacing  go 

i  Mrasuremenl 

1  focus 

Focus  on  both  vitemj*20d  and  tvternalifed  merit  j 
team  members  dunng  oomplex,  oneaif-a  kind,  cota 

Mettled  at  SHidy 

Macro  cognitive  processes  can  be  empncallr  studie 
eperatienel  tiaid  settings  »ven  domain  neh  etirahm 
soenanos. 

ivature  of 
OccMrrriire 

Macro  cogntwe  processes  (le.  mternataod  and  e‘t 
team  member  interacbon  (le.  sooallr  and  collsbixo 
mfluenoed  br  the  artifacts  in  the  envronment. 

bynamit 

1  reeture 

Macro  cogn^e  processes  develap  end  change  ox 

Fnvlronnsretol 

1  ConteNt 

Macro  cognitive  processes  are  domain  dependent ; 
environment  dependent  (e.g.  face  toface  versus  .i 
colaborabon  tools).  ^ 

•  SUMMIT  Homo 

•  IICF  Homrisaar 


Media  and  Documents 
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Agents  and  MacrocognItlon 


Stages  of  Collaboration  in  MacrocognMon 


we  of*  the  model  lAistreted  n  wamer.  tetskv.  and  Cowen  (2005)  vntiich  conceptuabed  a  set  of 
Rages  desenbmo  ooltaboratson  -  Knowledge  Construction,  CoOaborative  Team  Problem  Solvmg, 
Team  Consensus,  and  Outcome  Evaluabon  &  Kension  (see  descrntions  below),  we  are  using  these 
stages  to  heto  gude  our  identmcanon  of  pertinent  macrocogmtire  constructs  wchin  and  across 
these  Roots.  The  Reovs  ere  not  seauarrbel  but  ere  verv  dmamic  with  the  flow  of  commumcetiDn 


"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Meta-scientific  Level _ 

Creating  Conditions  for  Collaborative  Dialog 


Developing  Invited  Special  Issue  for  the  journal 
Theoretical  Issues  in  Ergonomic  Science 

□  Topic  related  to  Macrocognition 

□  Collaboration  and  Cognition  in 
Context 


□  Wi 


□ 


I  invite  theoreticians  from 
differing  disciplines  to  contribute 

Discuss  theoretical  issues 
surrounding: 

□  Interplay _  between  intra-  and 
inter-inaividuai  cognition 

□  Influence  of  contextuai 
variations 


Theoretical  Issues 

in  Ergonoinics  Science 


IMi  t  —  ■  I- 

,  .  .  T.  J' 

■1^  > 

1  <  .  1- 

j  1  -Phil 

OIEA 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 

Bounding  Theoretical  Issues 

□  This  component  is  addressing  need  to  identify  boundary 
conditions  around  theorizing  related  to  macrocognition. 

■  ASKING:  How  will  SUMMIT  explore  macrocognition? 


SUMMIT  Working  Papers  identifying 
and  articulating  theoretical  issues 
related  to  Macrocognition 

■  White  Paper  1. 1.  Memorandum  of 
Understanding  -  Theory  Deveiopment 
on  Macrocognition  in  Teams. 

■  White  Paper  1.2.  Micro-  Meso-  and 
Macro-ieveis  ofAnaiysis  in 
Coiiaborative  Probiem  Soiving. 

■  White  Paper  1.3.  Diagnosing 
Macrocognition  in  Teams  "In  the 
Head"  and  "In  the  Worid". 


% 

IMvERSiTYca?  Central  FLORIDA 
insttfufe  for 


I 


ILLINOIS 


Arizona  State 


University 


"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 

Bounding  Theoretical  Issues 

White  Paper  1.1.  Memorandum  of  Understanding  —  Theory  Development 
on  Macrocognition  in  Teams 

□  Worked  with  CKI  Program  towards  common  ground  on  theory  development 

■  Goal  to  ensure  outlining  conditions  appropriate  for  explanatory  model 

□  Ensure  boundary  conditions  are  identified 

■  Articulate  what  is  meant  by  initial  parameters  used  to  create  model 

□  Homoqeneitv/heteroqeneitv  within  teams  -  Talking  about  national  cultures 
(e.g.,  NATO)  or  talking  about  military  cultures  (i.e.,  joint  forces),  or  both? 


□  Types  of  teams  for  model 

■  Talking  about  multi-team  systems,  or  distributed- 
intact  teams  or  teams  of  teams 

□  Nature  of  the  task  environment 

■  Task  structure 

■  Task  complexity 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 

Bounding  Theoretical  Issues 

White  Paper  1.2.  Micro-  Meso-  and  Macro-levels  of  Analysis  in 
Collaborative  Problem  Solving. 

□  Macrocognition  as  Complex  System  -  Consists  of  web  of  frequently  non¬ 
linear  interrelations  between  variables 

■  Large  number  of  components,  self-organization,  and  emergence. 

■  Address  multi-level  and  multi-causal  phenomena  of  open  systems 


□ 


□ 


Not  ignore  interactions  among  multiple  levels 

■  Multi-level  theory  to  create  cross-level 
models  -  variables  impact  relationship  of 
upper-level  and/or  lower-level  variables 
(Klein,  Tosi,  &  Cannella,  1999) 

May  improve  diagnosis  of  causal  factors 

■  Hackman  (2003)  demonstrated  that 
moving  up  or  down  level  of  analysis  adds 
explanatory  power 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 


Developing  Theoretical  Concepts 

White  Paper  1.3.  Diagnosing  Macrocognition  in  Teams  ^Nn  the  Head''  and 
"In  the  World" 

□  Theoretical  issue  of  where  macrocognition  resides 

■  In  minds  of  individual  team  members,  as  an  emergent  property  visible  via  the 
interactions  of  the  teams,  or  some  combination  of  the  two 

□  Adopting  cognitive  science  concepts  at  individual  level  for  consideration  of 
measuring  at  macrocognition  level 

■  Off-line  measures  -  knowledge  related  to  problem  solving 

□  Sensitivity  and  Bias  -  to  conceptual  relations 

□  Simulation  Vignettes  -  knowledge  integration 

■  On-line  measure  of  process/movement 


□  Process  Flow  -  tracking  measures 


Question  33 


Click  on  image  to  view  the  animation  of  the  DDD  scenario 

Assume  you  are  DM1 .  DM2  has  requested  that  you  move  AW-504  over  1 
maximize  the  number  of  targets  that  ean  be  identified  in  DM2’s  seetor.  V 
be  the  BEST  action(s)  to  take? 


I  Attack  Aa5-219  with  TK-507  and  launch  another  tank  in 
case  you  identify  G7-200  as  an  enemy  with  AW-504  . 
Then  move  your  AW-504  over  DM2’s  base. 

I  Before  moving  AW-504  over  DM2’s  base,  identify  G?- 
I  200  and  G7-221 .  If  necessary,  ask  DM3  to  attack  those 
targets,  while  you  attack  Aa5-219  with  TK-507. 

I  Move  AW-504  over  DM2’s  base.  Next,  ask  DM3  to 
identify  and,  if  necessary,  attack  G7-200  and  G7-221 . 
Then,  attack  Aa5-219  with  TK-507. 

I  Move  AW-504  over  DM2’s  base.  Then,  attack  G7-200 
with  TK-507,  if  it  is  identified  as  an  enemy  target. 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 


Building  Theory 


□  This  component  is  addressing  need  to  evolve  theorizing 
related  to  macrocognition. 


■  ASKING:  What  does  SUMMIT  mean  by 
macrocognition  ? 


Z:^SUMMIT 


Developing  papers  to  identify  and 
articulate  theoretical  issues  related  to 
Macrocognition 

Fiore,  S.  M.,  Rosen,  M.,  Salas,  E.,  Burke,  S.,  & 

Jentsch,  F.  Processes  in  Complex  Team  Problem 
Solving:  Parsing  and  Defining  the  Theoretical 
Problem  Space.  To  appear  in  M.  Letsky,,  N. 
Warner,  S.  M.  Fiore,  &  C.  Smith  (Eds.). 
Macrocognition  in  Teams.  London:  Ashgate. 

Letsky,  M.,  Warner,  N.,  Fiore,  S.M.,  Rosen,  M.A.,  & 
Salas,  E.  (2007).  Macrocognition  in  Complex 
Team  Problem  Solving.  Proceedings  of  the  12^'^ 
Internationa i  Command  and  Controi  Research 
and  Technoiogy  Symposium.  Newport,  RI. 
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□  Initial  Definitions  of 
Terms 

□  Matrix  of  Functions, 
Processes,  and 
Stages 

Letsky,  M.,  Warner,  N.,  Fiore, 
S.M.,  Rosen,  M.A.,  & 

Salas,  E.  (2007). 
Macrocognition  in 
Complex  Team  Problem 
Solving.  Proceedings  of 
the  12^^  International 
Command  and  Control 
Research  and  Technology 
Symposium.  Newport,  Rl. 


FimctioiK 
nnd  Processes 

CoUaboiution  Stages 

Knowledge 

Constnictioii 

Problem 

Solving 

Consensus 

Evaluation 
and  Revision 

Individml  T earn  Knowledge 
Building  and  Development 

Pattern  recognition 

Mental  model  development 

Recognition  of  expertise 

Sharing  unique  knowledge 

Uncertainty  reduction 

Problem 

C  onceiJtualization 

Visualization  of  data,  meaning 

Building  common  ground 

Knowledge  sharing  and  transfer 

Team  problem  mo  del 

Shared  understanding  development 

Mampiilatiiig  Problem 

C  oucei>tiializatiou 

Critical  thinking 

Mental  simulation 

Intuitive  Decision  Making 

Option  generation 

Storyboarding 

Consensus 

Development 

Negotiation 

Outcome 

Appiuisal 

Feedback  structure 

Replanning 

Stage  Invaiiant  Processes 

Coordination 

Team  learning 

Workspace  awareness 

"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 


Building  Theory 

Fiore,  S.  M.,  Rosen,  M.,  Salas,  E.,  Burke,  S.,  &  Jentsch,  F.  (in  press).  Processes  in 

Complex  Team  Problem  Solving:  Parsing  and  Defining  the  Theoretical  Problem 

Space.  To  appear  in  M.  Letsky,,  N.  Warner,  S.  M.  Fiore,  &  C.  Smith  (Eds.). 

Macrocognition  in  Teams.  London:  Ashgate. 

□  Evolving  conceptualization  of  CKI  macrocognition  theory 

■  Next  step  of  definitional  exercise  (Letsky,  Warner,  Fiore, 

Rosen,  &  Salas,  2007) 

□  Attempt  to  reify  concepts  within  context  of  what  Letksy  et 
al.  (2007)  have  described  as  internalized  and  externalized 
cognition. 

□  More  clearly  convey  the  inter-relations  among 
macrocognitive  processes 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 

Building  Theory 

Fiore,  S.  M.,  Rosen,  M.,  Salas,  E.,  Burke,  S.,  &  Jentsch,  F.  (in  press).  Processes  in 
Complex  Team  Problem  Solving:  Parsing  and  Defining  the  Theoretical  Problem 
Space.  To  appear  in  M.  Letsky,,  N.  Warner,  S.  M.  Fiore,  &  C.  Smith  (Eds.). 
Macrocognition  in  Teams.  \.or\(\or\\  Ashgate. 


□ 


Figure  illustrates  conceptual  representation  -  Parallel,  interdependent,  and  iterative 
nature  of  processes  unfolding  in  the  context  of  collaboration. 


■  Illustrates  two,  four  person  teams  interacting  to 
solve  a  problem. 

□  Arrows  represent  iterative  nature  of  these 
processes  as  unfold  individually  and 
collectively. 

□  liiustrates  overaii  iterative  nature  of  process 
as  it  unfoids  over  individuais,  teams,  and 
across  teams. 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 


Building  Theory  -  Processes  in  Complex  Team  Problem  Solving:  Parsing  and  Defining 
the  Theoretical  Problem  Space 

Thematic  Elements 

□  Can  evaluate  what  is  occurring  as  collaboration  unfolds 

■  See  that  as  teams  move  through  stages  of  problem  solving,  there  is  a  continual  process 
of  an  "effort  after  meaning"  (cf.  Bartfett,  1932) 

□  We  see  an  evolution  of  understanding  within  the  team  based  upon: 

■  Interplay  between  the  perceptual  ^/7<y conceptual  -  integrating  visual  and  verbal 
understanding  to  make  meaning 

■  Increases  in  complexity 

□  Evolving  from  pattern  recognition  to  visualization  of  data  meaning  to  storvboardinq 


Ifidividual  and  Team 
Knowledge  Building 


Development  of  Shared 
Problem  Conceptualization 


Development 


onsensus 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 


Building  Theory  -  Processes  in  Complex  Team  Problem  Solving:  Parsing  and 
Defining  the  Theoretical  Problem  Space 

Thematic  Elements 


□  Continual  interplay  between  internalization  and  externalization 

■  For  example,  pattern  recognition  and  mental  model  development  along  with 
sharing  unique  knowledge  and  recognizing  expertise 

□  Understanding  of  constituent  elements  is  acquired  and  then  integrated  for  higher  level 
interpretation  and  sharing 

■  At  core  of  collaborative  problem  solving 

□  Interpreting  and  Interacting  -  Process  information  arising  from  the 
environment  and  held  by  team  to  comprehend  elements  of  problem  situation 


dividual  and  Team 
Knowledge  Building 


evelopment  of  Shared 
Problem  Conceptualization 


onsensus 

Development 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 

Building  Theory  -  Processes  in  Complex  Team  Problem  Solving:  Parsing  and 
Defining  the  Theoretical  Problem  Space 

Thematic  Elements 

□  Evolves  from  reduction  of  uncertainty  early  in  the  process  as  team  considers  both 
data  and  their  teammates  to  determination  of  plausibility 

■  Initially,  teams  interact  with  environment  and  each  other  to  better  understand 
information  arising  from  each 

■  Processes  are  then  engaged  to  act  upon  acquired  knowledge  and  evaluate 
utility  and  realizability  of  course  of  action 


dividual  and  Team 
Knowledge  Building 


evelopment  of  Shared 
Problem  Conceptualization 


onsensus 

Development 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  SUMMIT  Level 

From  This  -  Theoretical  Drivers  for  our  Research 

□  Driver  1.  Examine  the  evolution  of  understanding  within  the  team: 

■  Examine  the  interplay  between  the  perceptual  a/7<y conceptual  in 
collaborative  problem  solving 

□  Driver  2.  Understanding  iterative  nature  of  internalization  and 
externa  I  ization  of  knowledge 

■  Assess  how  interpretation  and  interaction  within  teams  support 
comprehending  task  elements 

□  Driver  3.  Understanding  evolution  from 
uncertainty  reduction  to  determination  of 

plausibility 

■  Explore  macrocognitive  processes 
driving  information  interrogation  and 
evaluation  during  collaboration 
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"Macrocognition  at  10^  Feet" 

-  Perspective  at  the  Project  Level 

Developing  Theoretical  Concepts  for  Experimentation 

□  This  component  is  developing  and  augmenting  existing  concepts  for 
macrocognition  research 

■  ASKING:  How  can  we  enrich  understanding  of  foundationai 
macrocognition  concepts  through  empiricai  studies? 

□  Concepts  for  Macrocognition 
Experiments 

■  General  Theoretical  Issues 

□  Understanding  Problem 
Space  and  Impact  of  Task 

□  Will  present  in  discussion  of 
Experiment  Thrust 


zr:\SUMMIT 
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Next  Steps  for  Multi-level  Perspective  to  Multi-Level  Theory 
Development _ 


□  “Macrocognition  at  10^  Feet”  -  Perspective  at  the  Meta- 
scientific  Level 


■  Creating  Conditions  for  Collaborative  Dialog  -  NEXT 


STEPS: 

□  Prospectus  for  special  issue  and  continued 
conference  participation 

“Macrocognition  at  10^  Feet”  -  Perspective  at  the 
SUMMIT  Level 


Building  Theory  for  Macrocognition  Research 
STEPS: 


NEXT 


□  Finalize  chapter  describing  theory 

□  Prepare  next  iteration  of  theory  development 

■  Manuscript  with  research  propositions 

■  Manuscript  integrating  metrics 

“Macrocognition  at  10^  Feet”  -  Perspective  at  the  Project 
Level 


■  Developing  Theoretical  Concepts  within  Macrocognition 
Research  -  NEXT  STEPS: 

□  Pursue  experimentation  based  upon  initial  theorizing 
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lacrocognr 
Year  One  Papers  and  Presentations 


Panels /Symposia 

Fiore,  S.M.  &  Salas,  E.  (2007).  Macrocognition  in  Teams:  Applying  Cognitive  Psychology  to  Support  our 

Understanding  of  Complex  Collaborative  Processes.  Panel  presented  at  the  7®^  Biennia!  Meeting  of  the  Society 
for  Appiied  Research  in  Memory  and  Cognition. 

Salas,  E.,  &  Fiore,  S.M.  (2007).  Macrocognition  Metrics:  Meaningful  Measures  for  Complex  Processes.  Panel  to  be 
presented  at  the  Annua!  Meeting  of  the  Human  Factors  and  Ergonomic  Society. 

Salas,  E.,  &  Hoffman,  R.  R.,  &  Fiore,  S.M.  (2007).  Multiple  Perspectives  on  the  Macrocognition  Construct.  Panel 
presented  at  the  8th  Internationa!  Conference  on  Naturaiistic  Decision  Making. 

Chapters/Articles  Year  One 

Fiore,  S.  M.,  Rosen,  M.,  Salas,  E.,  Burke,  S.,  &  Jentsch,  F.  (in  development).  Processes  in  Complex  Team  Problem 
Solving:  Parsing  and  Defining  the  Theoretical  Problem  Space.  To  appear  in  M.  Letsky,,  N.  Warner,  S.  M.  Fiore, 
&C.  Smith  (Eds.).  Macrocognition  in  Teams.  London:  Ashgate. 

Rosen,  M.A.,  Salas,  E.,  Fiore,  S.M.,  Letsky,  M.,  &  Warner,  N.  (under  review).  Tightly  Coupling  Cognition: 
Understanding  how  Communication  and  Awareness  Drive  Coordination  in  Teams.  Internationa!  Journai  of 
Command  and  Controi. 

Presentations  Year  One 

Rosen,  M.  A.,  Feldman,  M.,  Fiore,  S.  M.,  &  Salas,  E.  (under  review).  Augmented  Team  Cognition  for  Complex 
Problem  Solving  Tasks.  Preliminarily  accepted  to  Augmented  Cognition  Internationa!. 

Rosen,  M.  A.,  Lazarra,  E.H.,  Fiore,  S.M.,  &  Salas,  E.  (2007).  Team  problem  solving  tasks:  A  conceptual  review  and 
integration.  Second  Annua!  Interdiscipiinary  Network  for  Group  Research  Conference,  Lansing,  MI. 

Sims,  D.,  Rosen,  M.  A.,  Fiore,  S.  M.,  &  Salas,  E.  (2007).  Macrocognition:  How  dense  are  our  teams?  Second 
Annuai  Interdiscipiinary  Network  for  Group  Research  Conference,  Lansing,  MI. 


SUMMIT  Working  Papers 

□  White  Paper  1.1.  Memorandum  of  Understanding  -  Theory  Development  on  Macrocognition  in  Teams. 

□  White  Paper  1.2.  Micro-  Meso-  and  Macro-levels  of  Analysis  in  Collaborative  Problem  Solving. 

□  White  Paper  1.3.  Diagnosing  Macrocognition  in  Teams  "In  the  Head"  and  "In  the  World". 

□  White  Paper  1. 4.  Theoretical  Multilevel  Issues  for  Measuring  Complex  Team  Performance 
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Thank  You 

Questions  or  Comments? 


IMvERSiTYca?  Central  FLORIDA 
insttfufe  for  ^mulatim  & 


I 


ILLINOIS 


m 


Arizona  State 
University 


